METHOD AND SYSTEM FOR CONTROLLING ROBOTS 

The invention relates to a method for controlling a first 
robot and at least one other robot, the at least one other 
robot is calibrated relative to the first robot by determi- 
5 ning a coordinate transformation of the first robot relati- 
ve to the other robot and said transformation is stored in 
a control device of the other robot, as well as a system 
for controlling a first robot and at least one other robot 
with a device for calibrating at least one other robot re- 
10 lative to the first robot by determining a coordinate 

transformation of the first robot relative to the other ro- 
bot and with a memory means in the control device of the 
other robot for storing this transformation. 

15 US 6 330 493 Bl relates to the coordinated or cooperative 
operation of a plurality of robots. In such an operation 
one of the robots functions as master robot and the other 
as slave robots. For this purpose, by calibration, a 
transformation matrix between the robots is determined, in 

20 that e.g. in the world coordinate system of a first robot 
the position of another robot is determined. According to 
this document the transformation determining the position 
of the first robot in the world coordinate system of the 
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second robot is the inverted, first -mentioned transformati- 
on, so that the transformation only has to be determined 
once, e.g. that of the other robot in the system of the 
first robot and the inverted transformation can be used for 
5 determining the first robot in the system of the second ro- 
bot, without a further determination being necessary. This 
academic approach implies in the same way that in the case 
of three robots the third robot only has to be determined 
in the coordinate system of one of the two robots, e.g. the 
10 second robot and all the other coordinate transformations 
can be obtained mathematically from the determined one. 

As a result of robot kinematics this academic approach is 
incorrect, because the transformation of one robot relative 

15 to another cannot be simply inverted in order to determine 
a precise transformation of the other robot relative to the 
first robot. This more particularly applies when operating 
robots under a load, because there is then a significant 
deflection of up to 10 mm in the case of certain robots and 

20 this is also dependent on the location of a robot within 
the working area. 

In addition, the calibration of a robot in the system of 
another robot normally takes place in such a way that the 
25 robots move to up to three positions in the area not loca- 
ted on a line and the positions are determined in the given 
coordinate systems of the robots and subsequently from the 
three position data the transformation of one robot relati- 
ve to the other is calculated. 

30 

If for calibration purposes use is made of a fourth positi- 
on of each robot, then an overdetermination occurs, as a 
result of which by iterative optimization the roots of the 
sum of the squares (L2 standardization) of the given 12 
35 vector (3 coordinates of 4 points) implying the difference 
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between the locations of the components of the coordinate 
system of one robot and the transformed coordinate compo- 
nents of the four points of the other robot is minimized. 
This gives a nonlinear equation with several minima. Thus, 
5 the robots can find different local minima, so that in this 
case the transformation are from a first robot to another 
is not necessarily the inverse of the transformation from 
the other robot to the first. 

10 The problem of the invention is to provide a method and a 
system by means of which the control of cooperating robots 
is improved and can be optimized for all the partial regi- 
ons of their common operating areas. 

15 According to the invention this problem is solved by a me- 
thod of the aforementioned type, which is furtheron charac- 
terized in that also the first robot is calibrated relative 
to the other robot by the determination of at least one in- 
dependent coordinate transformation and said at least one 

20 independent transformation is stored in a control device of 
the first robot. For solving the said problem the invention 
also provides a system for controlling robots, having a de- 
termination device for calibrating the first robot relative 
to the other robot by the determination of at least one in- 

25 dependent coordinate transformation of at least one other 

robot relative to the first robot and by a memory device in 
a control device of the first robot for storing at least 
one independent transformation. 

30 According to a preferred variant of the invention, in the 

case of at least three robots, each robot is calibrated re- 
lative to the others by at least one independent determina- 
tion of coordinate transformations and the at least one 
transformation of the calibration of each robot is stored 

35 in a control device thereof or that in the case of at least 
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three robots, each of the robots has in its control device 
a means for the calibration thereof relative to each of the 
other robots by determining at least one coordinate trans- 
formation with respect to each of the other robots, as well 
5 as a memory means for storing the in each case at least one 
coordinate transformation . 

In a preferred development of the method according to the 
invention, for each robot several calibrations are perfor- 

10 med each at different positions, and the thus obtained 

transformations are stored. This implies that the calibra- 
tion of one robot relative to the other robot takes place 
at another, different position to the calibration of the 
other robot relative to the first robot. This also implies 

15 that for different positions and therefore different opera- 
ting regions in each case individual calibrations or deter- 
minations of the coordinate transformations can be perfor- 
med for each robot, 

20 In a further preferred development of the inventive method, 
in the case of cooperating operation of at least two ro- 
bots, the coordinates of the independent robot and the 
coordinates transformed relative thereto of the independent 
robot or robots are used and in particular in operating 

25 area -dependent manner the coordinates of one robot and the 
coordinates transformed relative thereto of one or more 
other robots are used. Whereas in principle both systems 
in the coordinate system of the independent robot and con- 
sequently the independent robot or robots operate in the 

30 transformed coordinate system obtained from the coordinate 
system of the independent robot, in operating area- 
dependent manner it is also possible despite maintaining 
the feature as an independent robot, such an independently 
operating robot can operate with the coordinate system ob- 

3 5 tained from the transformation of the coordinate system of 
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a dependently operating robot and the corresponding depen- 
dently operating robot operates in its original coordinate 
system - as well as optionally further dependently opera- 
ting robots in their transformed coordinate system obtained 
5 from the original coordinate system of the one dependent 
robot . 

In a further preferred development of the method according 
to the invention, in the case of cooperating operation of 
10 at least two robots, as desired, one of the robots can be 

used as an independent robot and the at least one other ro- 
bot as a dependent robot and in particular during an opera- 
ting process the characteristic of the robots as indepen- 
dent or dependent robots is changed. 

' 15 

In a preferred embodiment the system according to the in- 
vention is implemented for the performance of the above - 
defined method variants. 

20 The invention makes it possible in the case of cooperating 
operation of the robots not only to use the robot as an in- 
dependent robot and also at least one other as a dependent 
robot, but also to use an appropriate coordinate system ac- 
cording to which one of the robots is the independent robot 

2 5 and the other is the dependent robot also dependent of ope- 
rating areas, in which the position differences resulting 
from real technology are minimized and the use of different 
positions is avoided for mathematical reasons. The inventi- 
on makes the following possible: When two or more robots 

30 cooperate, one robot A can be independent with another ro- 
bot B dependent on robot A. In this case, robot B uses a 
transformation obtained by its calibration to robot A. When 
robot B becomes the independent and robot A is then depend- 
ent on robot B, robot A uses a transformation obtained by 

35 its calibration to robot B. One transformations are more 
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precise because they take into account the physical area of 
operation where the robots cooperate. Calibration was per- 
formed in the region of cooperation. 

5 It is also possible in the first case to operate in certain 
operating areas with the coordinate systems of the second 
robot and also the transformed system of the second robot 
obtained therein by the calibration of the first robot, be- 
cause the thus determined positions in such partial areas 
10 are more precise than when operating in the world coordina- 
te system of the first robot and the transformation thereof 
to the second robot. 

The same applies for cooperative operation of more than two 
15 robots, in which each can be used as an independent robot 

and for specific partial areas of the cooperation of robots 
it is possible to assume a suitable world coordinate system 
of one of the cooperating robots . 

20 Due to the fact that the calibration of each of the robots 
takes place relative to each other robot and is stored in 
the control device of the correspondingly calibrated robot, 
according to the invention independently determined trans- 
formations are stored, which can be different from the in 

25 each case inverted transformations. 

Thus, each robot can obtain its measurements from different 
positions. Multiple local regions for each pair of two ro- 
bots can be calibrated in each direction. 

30 

The invention is decided below with reference to embodi- 
ments in the drawing. 

BRIEF DESCRIPTIOPN OF THE DRAWINGS 
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Fig. 1 shows a simple, diagrammatic representation of two 
cooperating robots. 

5 Fig. 2 shows a view of two robots to be calibrated in three 
regions . 

Fig. 3 to Fig. 5 shows a view of two robots handling to- 
gether an object in three regions. 

10 

Fig. 6a to 6c shows f lowdiagrams of the movement of the ro- 
bots when gripping and transferring an object. 

Each of the two cooperating robots A, B has a control devi- 
15 ce A.l or B.l, which implies a device A. 2, B.2 for calibra- 
ting one robot (A, B) in the coordinate system of the other 
robot (A, B) and for determining the corresponding coordi- 
nate transforms robot B.regioni . transform, robot 

A. regioni . transform in regions i=l,2... (represented in the 
20 form of continuous line arrows) and a storage device A. 3, 

B. 3 for storing the corresponding coordinate transforms ro- 
bot B. regioni . transform, robot A. regioni . transform (illu- 
strated by broken line arrows) . 

25 In fig. 1 point PI represents the operating point of the 
tool centre point taught to the robot 2 and point PIP the 
same point correspondingly taught to robot 1, but which as 
a result of robot kinematics, loading conditions, etc., 
does not precisely coincide with point PI, but can instead 

30 diverge slightly therefrom. 

Fig. 2 shows two robots, robot A and robot B, to be cali- 
brated with regard to each other in three region s, region 
1, region 2, region 3, which are local entities. Their use 
35 is specified by the program. Either robot can be dependent 
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on the other, so each robot must be calibrated to the other 
once for each working region. There are a total of 6 cali- 
brations . 

5 Known calibration tools A. 4 , B.4 are mounted to the face- 
plates of each robot. 

First robot A is calibrated to robot B in region 1 . In a 
first step calibration is initiated from robot A. Then ro- 

10 bot A is jogged into region 1. Robot A is jogged so that 

its calibration tool tip touches Robot B*s calibration tool 
tip. The current position of Robot A is stored and the cur- 
rent position of Robot B is sent to Robot A. This procedure 
is repeated for three other positions in region 1. Stan- 

15 dardized algorithms are employed to calculated the trans- 
form from robot A to robot B. The fourth point is used for 
iterative optimization. The transform is stored on the con- 
troller for robot A as robot 
B . regionl . transf orm= {x,y , z,a,b,c} . 

20 

Subsequently other calibrations having identical procedures 
for robot A to robot B in regions 2 and 3 are performed re- 
sulting in transforms robotB . region2 . transf orm and robot 
B.region3 . transform and for robot B to robot A in regions 1 
2 5 to 3 are performed resulting in transforms robot 

A. regionl. transform, robotA. region2 . transf orm and ro- 
botA . region3 . transform . 

When robot A is calibrated to robot B in region 1 and robot 
30 B is calibrated to robot A in region 1, different calibra- 
tion points can be used because each calibration is per- 
formed separately. 

Once the robots are calibrated to each other, frames of 
35 reference relative to the opposite robot are created so 
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that the robots can spatially cooperate or link. Here a 
frame is a transform. In figure 3, a frame PartlnGripper- 1 
is shown. This frame represents the part as it is held in 
the gripper A. 5 by robot A. The frame is the transform from 
5 the faceplate of the robot to a reference point on the 

part. The frame is defined such that its parent is robot A 
in region 1. This information is kept with the frame data. 
The gripper of the other robot B is labelled as B.5. Figure 
7 shows the same frame, but in region 2. This frame, Part- 

10 InGripper-2, is actually a different frame data and is 

stored separately from PartlnGripper- 1 . PartlnGripper - 2 is 
relative to robot A in region 2. Figures 8 shows Par tin - 
Gripper-3 frame relative to robot A in region 3. Positions 
are relative to frames. When a position is relative to a 

15 fixed frame, the position is always in the same place. When 
the position is relative to a frame that is relative to the 
faceplate of a robot, the position moves with the frame. 
The frame moves with the robot. You described this well in 
the patent application on page 9 paragraph 3. 

20 

Programmed positions are defined relative to frames. A po- 
sition defined relative to the robot's world frame repre- 
sents a location and orientation that are fixed with re- 
spect to the robot base. A position defined relative to any 
2 5 of the PartlnGripper frames is relative to the position of 
Robot A. As the robot moves, so does the frame and the po- 
sition. 

The calibrations made are used with cooperting robots as 
30 follows: 

Robot A starts as the independent robot and moves from re- 
gion 1 to region 2 to region 3. Robot B is dependent on ro- 
bot A and will follow robot A in all three regions. The 
35 programmed motion essentially specifies the region. 
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First robot a picks up a part and moves it moves into re- 
gion 1 (step A of Fig. 6a) , whereas robot B moves to a 
perch position near Robot A (step Ba) . The programs on Ro- 
5 bot A and Robot B rendezvous, "Ready to Link" (Ab, Bb) . 

This means that A sends an message to B that it is ready to 
link Robot A then waits for a message from B that it is 
ready to link. Robot B asynchronously sends a message to A 
that it is ready to link. Then, both programs proceed. Ren- 
10 dezvous is accomplished using a program synchonization, 

e.g. the features as described in the co- pending patent ap- 
plication "Method and Apparatus for the synchronous control 
of manipulators" to Stefan Graf, Andreas Hagenauer, Michael 
Chaffee and Kenneth Stoddard filed on May 14, 2003. 

15 

Robot B moves to a programmed position relative to Partln- 
Gripper-1 frame. For this motion, the controller must de- 
termine what Partln-Gripper- 1 frame is relative to (Bbl) . 
During setup, this frame was assigned to be relative to ro- 

20 bot A.regionl. This causes B to link to A (Bb3) , crating a 
dependency on robot A as described in the coopending US 
patent application Ser.No. 10/406,521 of April 03, 2003 
"Method and Control System for controlling a Plurality of 
Robots" to Kenneth A. Stoddard et. al . The actually linking 

25 process involves communications between the robots. The 

programs on both rendezvous when "linked" (Ac, Be) . Robot A 
moves within Region 1. Robot B follows (Ad, Bd) . The pro- 
grams on both rendezvous to signify they are ready to un- 
link (Ae, Be) . Robot B moves to a position ultimately rela- 

30 . tive to its own world frame (Bel) . The link is broken by 

this motion command as described in the above mentioned ap- 
plication 10/406,521 a Robot B is no longer dependent on 
robot A (Af , Bf ) . The programs on both robot rendezvous 
when unlinked. The program continues in exactly the same 

35 fashion for the two other regions, except the calibration 
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for each region is based on the PartlnGripper frame used. 
PartlnGripper- 2 frame is relative to a robot A in region 2, 
so the calibration data RobotA . Region2 .Transform is used 
when a link is performed in region 2 - likewise for region 
5 3. This is given in flow diagrampats Fig. 6b and Fig. 6c. 

The whole scenario can be repeated with robot B as the in- 
dependent robot and robot A dependent on robot B in swap- 
ping of roles of independent and dependent robots. In this 
10 case the calibration data used would be Ro- 
botB . Region . Trans form . 

Since a load can cause different amounts of deflection 
based on the position of the robot, calibration can to do 
15 this, the calibration procedure must be performed with the 
load in place. This way the deflection occurs and the cali- 
bration includes the deflection. 



